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DIRECT CALL THREADED CODE 
By 

Ian R. Finlay 
Douglas James Doole 

BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention relates to relational database management systems, and more 
particularly to a method for optimizing execution of queries in a relational database management 
system. 

Description of the Related Art 

A database management system (DBMS) comprises the combination of an appropriate 
computer, direct access storage devices (DASD) or disk drives, and database management 
software. A relational database management system is a DBMS which uses relational techniques 
for storing and retrieving information. The relational database management system or RDBMS, 
such as the DB2 product from IBM, comprises computerized information storage and retrieval 
systems in which data is stored on disk drives or DASD for semi-permanent storage. The data is 
stored in the form of tables which comprise rows and colunms. Each row or tuple has one or 
more columns. 

The RDBMS is designed to accept commands to store, retrieve, and delete data. One 
widely used and well-known set of commands is based on the Structured Query Language or 
SQL. The term query refers to a set of commands in SQL for retrieving data from the RDBMS. 
The definitions of SQL provide that a RDBMS should respond to a particular query with a 
particular set of data given a specified database content. SQL however does not specify the 
actual method to find the requested information in the tables on the disk drives. There are many 
ways in which a query can be processed and each consumes a different amount of processor and 
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input/output access time. The method in which the query is processed, i.e. query execution plan, 
affects the overall time for retrieving the data. The time taken to retrieve data can be critical to 
the operation of the database. It is therefore important to select a method for finding the data 
requested in a RDBMS which minimizes the computer and disk access time, thereby optimizing 
5 the cost of doing the query. 

To execute a SQL statement, such as "select * from tl", in a RDBMS program like DB2 
the statement is presented to the SQL optimizer. The SQL optimizer parses, tokenizes and 
semantically analyzes the statement, transforming it into the Query Graph Model (QGM) 
representation of the statement. The QGM representation is then processed to perform a number 
10 of heuristic optimizations. The output of this pass is then fed to the cost-based planning stage. 
The cost-based planning stage processes the optimized QGM, producing an access plan, based 
on LOw LEvel Plan OPerators (LOLEPOPs). The plan produced by the cost-based optimizer is 

I'S then processed by a Code Generation module (CODGEN) to produce an OPeration Code 

If! (OPCODE) based access plan, which can be processed at runtime by a Relational Database 

3 15 System (RDS). 

In prior versions of RDBMS programs, such as DB2 (Versions 5.2 and older), the 

=0 OPCODE based access plan is interpreted at runtime by the Relational Database System (RDS). 

Q The Relational Database System examines each OPCODE, and looks up the function which is 

called to process the OPCODE and its operands. The processing for the OPCODE includes 

i-fl 20 loading the OPCODE'S operands and making decisions based on information associated with the 
OPCODE that was provided at CODGEN time. These decisions are made repeatedly, each time 
the OPCODE processing function is called, and direct the function of the OPCODE. An 
alternative implementation involved producing multiple OPCODEs for these similar functions. 
This approach still results in considerable duplication in underlying OPCODE processing. 
25 It will be appreciated that one of the principle problems with existing RDBMS programs, 

such as the DB2 product, is the fact that the RDBMS includes an interpreter which executes 
during runtime. Since the interpreter translates and runs the OPCODEs at the same time, 
operation during runtime is considerably slower than for a compiler based implementation. In 
view of the costs associate with replacing existing interpreter-based RDBMS programs, there 
30 remains a need for a mechanism which can improve the slower runtime performance of the 
interpreter phase in such systems. 
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SUMMARY OF THE INVENTION 

The pre-pass mechanism of to the present invention replaces the repeated looking up of 
the function to call to process the OPCODE and the function's operands, and any decisions that 
need to be made repeatedly (i.e. static decisions), during the interpreter phase of execution. The 
5 pre-pass mechanism comprises a pre-processing function which replaces or augments the 
OPCODE, and any static decisions, with a pointer to the function to call to perform the operation 
specified by the OPCODE, or a pointer to an intermediate function with an auxiliary data 
structure, or a pointer to an auxihary data structure, wherein the auxiUary data structure includes 
a pointer to the function to call to perform the operation specified by the OPCODE. 
10 Advantageously, the pointers are called without additional lookup. The intermediate function to 
call to perform the function specified by the OPCODE may include processing operations and 
Z static decision making. 

M In a first aspect, the present invention provides a method for pre-processing an access 

fj plan generated for a query in a relational database management system. The access plan has a 

U 15 plurality of operation codes including a first operation code and is stored in memory, each of the 
3 operation codes being associated with one or more executable functions for performing the 

^ query. The method comprises the steps of: (a) retrieving the access plan from memory; (b) 

^ determining an executable function associated with the first operation code in the access plan; (c) 

g augmenting the first operation code in the access plan with a pointer to the executable function; 

t 20 (d) repeating steps (b) and (c) for the remaining operation codes in the access plan; (e) storing 
the modified access plan in memory. 

In a second aspect, the present invention provides a relational database management 
system for use with a computer system wherein queries are entered by a user for retrieving data 
from tables, the relational database management system includes a query optimizer for 
25 generating an access plan associated with the queries entered by the user, the relational database 
management system comprises: (a) means for retrieving the access plan generated for a query 
from memory; (b) means for determining an executable function associated with each of the 
operation codes in the access plan; (c) means for augmenting the operation codes in the access 
plan with a pointer to the associated executable function; (d) means for storing a modified access 
30 plan in memory. 

-3- 

CA990018US1 



IBM CONFIDENTIAL 



In another aspect, the present invention provides a computer program product for use on 
a computer wherein queries are entered by a user for retrieving data in a relational database 
management system having a query optimizer for generating an access plan for executing the 
query, the computer program product comprises: a recording medium; means recorded on the 
5 medium for instructing the computer to perform the steps of, (a) retrieving the access plan from 
memory; (b) determining an executable function associated with the first operation code in the 
access plan; (c) augmenting the operation code in the access plan with a pointer to the executable 
function; (d) repeating steps (b) and (c) for the remaining operation codes in the access plan; (e) 
storing the modified access plan in memory. 

10 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 shows in diagram form a computer system for the present invention; 

FIG. 2 shows in flowchart form the steps for the interpretation and execution of SQL 
statements in the context of the present invention; 

FIG. 3 shows in flowchart form the steps for translating OPCODE to function pointers 
1 5 according to the present invention; 

FIG. 4 shows in flowchart form the steps for execution of the translated OPCODE 
according to the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 

Reference is first made to FIG. 1 which shows an exemplary computer system 10 which 
20 is suitable for use with the present invention. As shown in FIG. 1, the computer system 10 
comprises one or more processors connected to one or more electronic storage devices 12 and 
14, such as disk drives, that store one or more relational databases. Users of the computer 
system 10 use a standard operator interface 16, such as OS/2 or other similar interface, to input 
commands for performing various search and retrieval functions, termed queries, against the 
25 databases. In the context of the present invention, these queries conform to the Structured Query 
Language (SQL) standard, and invoke functions performed by a Relational Database 
Management System (RDBMS). In the preferred embodiment of the present invention, the 
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RDBMS software comprises the DB2 product offered by IBM for the MVS or OS/2 operating 
systems. Those skilled in the art will however recognize that the present invention has 
appUcation to any RDBMS program that utihzes SQL. 

As shown in FIG. 1, the DB2 architecture for the MVS operating system includes three 
5 major components: an IMS Resource Lock Manager (IRLM) 18, a System Services module 20, 
and a Database Services module 22. The IRLM 18 handles locking services because DB2 treats 
data as a shared resource, thereby allowing any number of users to access the same data 
simultaneously. As a consequence, concurrency control is required to isolate users and to 
maintain data integrity. The System Services module 20 controls the overall DB2 program 
10 execution environment, which includes managing log data sets 14, gathering statistics, handling 
startup and shutdown, and providing management support. 

At the center of the DB2 architecture is the Database Services module 22. The Database 
Services module 22 contains several sub-modules, including the Relational Database System 
(RDS) 24, the Data Manager 26, and other components such as a SQL compiler. These sub- 
iQ 15 modules support the functions of the SQL language, i.e. definition, access control, retrieval, and 
'^■^ update of user and system data, 

•=3 Reference is next made to FIG. 2 which shows in flowchart form the steps for the 

interpretation and execution of SQL statements in the context of the present invention. Block 
102 represents the input by the user of SQL statements into the computer system 10. Block 103 

20 represents the step of checking to determine if the RDBMS has previously processed the SQL 
statements input by the user. If the SQL statements have already been processed, then the access 
path plan is retrieved in Block 107 and processed as described below. If SQL statements have 
not been processed, then processing is performed starting at Block 104. Block 104 represents the 
step of compiling or interpreting the SQL statements. Block 106 represents the step of 

25 generating a compiled set of runtime structures called an execution or access path plan firom the 
compiled SQL statements. Generally, the SQL statements received as inputs from the user 
specify only the data that the user wants, but not how to get it. This step considers both the 
available access paths (i.e. indexes, sequential reads, etc.) and system held statistics on the data 
to be accessed (i.e. the size of the table, the number of distinct values in a particular column, etc.) 

30 to choose what it considers to be the most efficient access path for the query. Block 109 

represents the step performed in the Access Plan Manager (included in the RDBMS 24 - FIG. 1) 
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for storing the access path plan (as generated through Block 106) into a system table which 
allows future re-use of the access path plan. If the SQL statements (i.e. query) was previously 
processed (as determined in block 103), then the access path plan is retrieved from the system 
tables as indicated by Block 107. Block 108 represents the step of determining if the access path 
5 plan is still vahd. In Block 108, the Access Plan Manager examines the retrieved access path 
plan to ensure that the plan is still vahd, i.e. all indexes, tables, etc. still exist in the RDBMS. If 
the access path plan is not vahd, then a new access path plan needs to be generated starting at 
Block 104 (as described above). If the access path plan is valid, then the next step in Block 109 
involves storing the access path plan in the system tables. The access path plan is also stored in a 
10 memory cache as indicated in Block 109. Block 110 represents the execution of the application 
plan. A pre-pass function according to present invention within block 110 improves runtime 
performance as will be described below. Block 112 represents the output of the results of the 
n apphcation or access path plan to the user. 

l: In prior art systems as described above, the apphcation or access plan is generated by a 

y 

0 15 cost-based optimizer and then processed by a Code Generation module (included in other 
components 22 shown in FIG. 1) to produce an Operation Code (OPCODE) access plan. The 
^ OPCODE access plan is then stored in the main memory cache for the computer system 10. To 

J execute the SQL statement (block 110), i.e. the access plan, according to the prior art, the 

computer system 10 would first retrieve the section of code from the memory cache. An 
0 20 instruction pointer (IP) is initialized to point to the first entry in the hst of operations, or 
5 OPCODES, that describe what is to be done to execute the SQL statement. The Relational 

Database System (RDS) uses the OPCODE to look up a corresponding function (F) in a look-up 
table. The look-up table contains the mapping of every OPCODE supported by the database 
engine 26 to the executable function that performs the operation associated with the OPCODE. 
25 Next the function (F) is called by the RDS to apply the function as required. A "return" code is 
also returned along with a next instruction pointer (IPNxt). The retum code indicates whether 
execution is to stop or continue, and the next instruction pointer (IPNxt) points to the next 
operation that is to be executed now that the current operation is complete. The retum code 
typically indicates STOP if the SQL request had been completed. It will be appreciated that with 
30 this prior art approach, the OPCODE may be looked up and executed multiple times in the 
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course of processing an SQL request. Repeated execution is further compounded by nested SQL 
requests. 

According to the present invention, a pre-pass function or mechanism is included in block 
110. The pre-pass function pre-processes the access path plan for the SQL statement before 
5 storage in the memory cache. The pre-processing comprises looking up the OPCODES to 
determine the corresponding function to execute with each OPCODE. The OPCODE is replaced 
or augmented with a pointer to the function to call to perform the operation specified by the 
OPCODE. The pre-processing further includes an examination of the function and runtime 
environment to determine more precisely which function best suits the operation being requested 
10 for the SQL statement. 

According to another aspect of the pre-pass mechanism, an intermediate processing 
function may be inserted either during this pre-pass stage, or at a later processing stage, to 
% provide additional, auxiliary processing capabilities. The pointer to the function to call to 

il process the operation specified by the OPCODE is replaced by a pointer to the intermediate 

:0 15 processing function and an auxiliary data structure. The auxiliary data structure includes a 
5 pointer to store the pointer to the function to call to process the operation specified by the 

3 OPCODE. The intermediate function provides the capability to perform additional, auxiliary 

:3 processing such as gathering statistics on the function which process the operation specified by 

the OPCODE, or requesting input from a user via the terminal interface 16, before or after 

y 

'0 20 calling the function to process the operation specified by the OPCODE. According to another 
-5 aspect, the pointer to the function to call to process the operation specified by the OPCODE is 

augmented with another pointer to the auxihary data structure. 

Reference is made to FIG. 3 which shows in flowchart form the steps for performing a 
pre-pass function according to the present invention indicated generally by reference 200. The 
25 pre-pass function is performed by the Access Plan Manager (APM) in the RDBMS 24 (FIG. 1) 
prior to storing the access path plan into the memory cache, but after storing the unaltered access 
path plan in the system tables. This allows for future reuse of the access path plan should the 
user input the same SQL statements at a later time. Block 202 represents the first step in the pre- 
pass function and involves loading the code section from the memory cache. Block 204 
30 represents the step of initializing a loop counter LC to 1 for looping through all of the OPCODES 

in the code section. Block 206 represents the steps of looking up the function F corresponding to 
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the OPCODE being referenced by the loop counter LC. In addition, the function is examined to 
determine if a more specific function can be used to process this request. If a more specific 
function exists, it is selected to replace the function F. Block 208 represents the step of storing a 
call pointer to the function F for the OPCODE being referenced by the loop counter LC. 
5 Alternatively, block 208 may also include steps for storing a call pointer to an intermediate 
processing function, an auxihary data structure, wherein the auxiliary data structure includes a 
call pointer to the function F for the OPCODE being referenced by the loop counter LC. The 
call pointer is stored in a function pointer OP_F(LC) and is indexed by the current value of the 
loop counter LC which corresponds to the OPCODE being currently processed. Block 210 

10 represents a decision step which checks the loop counter LC to determine if all the OPCODES in 
the code section have been processed. If all the OPCODEs have not been processed, then the 
loop counter LC is incremented in block 212 and the steps in blocks 206 to 210 are repeated for 
the remaining OPCODEs. Once all the OPCODEs are processed, the processed code section is 
stored in the memory cache (Block 214) and the pre-pass function 200 ends (Block 216). The 

15 processed code section includes the function pointers corresponding to the OPCODEs previously 
stored in the code section, and the code section is ready for execution. 

Reference is next made to FIG. 4, which shows the sequence of steps for executing a 
SQL request which has been processed by the pre-pass function 200 (FIG. 3). As shown in FIG. 
4, Block 302 represents the first step which involves retrieving the processed code section from 

20 the memory cache. Block 304 represents the step of initializing an instruction pointer IP to point 
to the first function entry in the code section. Block 306 represents the step of the RDS calling 
the function that is being referenced by the function pointer that is pointed to by the instruction 
pointer OP_F(IP) to execute the function being referenced. In addition, a return code RC and a 
next instruction pointer IPNxt are returned in Block 306. The retum code RC indicates whether 

25 to stop or continue, and the next instruction pointer IPNxt indicates the next function pointer that 
is to be called now that the current function has been executed. Block 308 represents the step of 
checking if the retum code RC indicates STOP. The retum code RC indicates STOP if the SQL 
request has been completed. If not completed, the instruction pointer IP is set to the value of the 
next instruction pointer IPNxt and the steps in Blocks 306 to 308 are repeated. 

30 It will be appreciated that the pre-pass mechanism according to the present invention 

replaces the need for the repeated looking up of the function to call in order to process the 
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OPCODE and its operands. The pre-pass mechanism also replaces any decisions that need to be 
made repeatedly (i.e. static decisions). The look up operation to the function is replaced with a 
pointer to the function, whereas static decisions are replaced by pre-processing operation(s). 

There are a number of processing options that can be performed with the pre-pass 
5 mechanism. For example, the RDS in the current version of DB2 has a save/restore that is 
always performed for all new subroutines that start up. These operations are not always 
required, as the information they save is not always affected by the operations that are performed 
within a section. The save/restore operations can be moved into entry/exit routines, that are then 
tacked on to the start and end of the subroutine, thus saving considerable overhead for sections 
10 that are repeatedly called, and that do not require the save/restore. As described above, static 
decisions may also be moved into a pre-processing function, allowing the removal of 'if-then- 
else' decisions from the normal runtime path. This is particularly beneficial for decisions that 

'5 are included due to the general nature of some operands, but that rarely are used. Removing 

such decisions from being made repeatedly offers significant performance improvements for 

:y 15 such operations. An example of such a decision is code page translation for string operations. 

'L; Although operands are often in the same code page, it is still necessary to confirm this, but it 

need only be confirmed once. If the operands are in the same code page, then a more optimal 

□ string operator may be called, otherwise, a more general string operator, which takes into 

account dissimilar code pages, must be called. Similar conditions exist for predicates, and 

JJ 20 mathematical operators, where optimal functions may be called to handle like-to-like operands, 
in place of the general operators which handle dissimilar operands. 

The present invention may be embodied in other specific forms without departing from 
the spirit or essential characteristics thereof Therefore, the presently discussed embodiments are 
considered to be illustrative and not restrictive, the scope of the invention being indicated by the 
25 appended claims rather than the foregoing description, and all changes which come within the 
meaning and range of equivalency of the claims are therefore intended to be embraced therein. 
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WHAT IS CLAIMED IS: 

1 1 . A method for pre-processing an access plan generated for a query in a relational database 

2 management system, said access plan including a plurality of operation codes, each of said 

3 operation codes being associated with one or more executable functions for performing the 

4 query, said method comprising the steps of: 

5 (a) determining from the access plan an executable function associated with a first 

6 operation code; and 

7 (b) augmenting said first operation code in the access plan with a pointer to said 

8 executable fimction. 
9 

1 2. The method as claimed in claim 1, further comprising repeating steps (a) and (b) for the 

2 remaining operation codes in the access plan. 

1 3. The method as claimed in claim 1, wherein said step (b) comprises augmenting said first 

2 operation code in the access plan with a pointer to an intermediate function, said intermediate 

3 function including a data structure for storing a pointer to said executable function. 

1 4. The method as claimed in claim 3, wherein said data structure includes means for storing 

2 information associated with said executable function or said first operation code. 

1 5. The method as claimed in claim 1, wherein said step (b) comprises augmenting said first 

2 operation code in the access plan with a second pointer to a data structure, said data structure 

3 providing means for storing information associated with said first operation code or said 

4 executable function. 



1 



6. 



The method as claimed in claim 1, wherein said step (a) further includes assessing the 
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2 executable function associated with the first operation code and if applicable, replacing the call 

3 to the executable function with a call to a second executable fiinction. 

1 7. The method as claimed in claim 3, wherein said intermediate function includes 

2 processing operations for the first operation code or the executable function associated with the 

3 first operation code. 

1 8. The method as claimed in claim 7, wherein said processing operations in the intermediate 

2 function include gathering statistics on the use of the executable function associated with the 

3 operation code. 



11 1 9. The method as claimed in claim 7, wherein said processing operations in the intermediate 

M 2 function include a pause for receiving user input before or after the call to the executable 

^ 3 function. 

1 10. A computer program product for use on a computer wherein queries are entered by a user 

2 for retrieving data in a relational database management system having a query optimizer for 



3 generating an access plan for executing the query, said computer program product comprising: 



4 



a recording medium; 



5 



means recorded on said recording medium for instructing said computer to perform the 



6 steps of: 



7 



(a) determining an executable function associated with a first operation code in the 



8 access plan, the first operation code being one of a plurality of operation codes; and 
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9 (b) augmenting said first operation code in the access plan with a pointer to said 

1 0 executable function. 

1 11. The computer program product as claimed in claim 10, the means for instructing said 

2 computer further comprising repeating steps (a) and (b) for the remaining operation codes in the 

3 access plan. 

1 12. The computer program product as claimed in claim 10, wherein said step (b) comprises 

2 augmenting said first operation code in the access plan with a pointer to an intermediate fimction, 

3 said intermediate function including a data structure for storing a pointer to said executable 

4 function. 

1 13. The computer program product as claimed in claim 12, wherein said data structure 

2 includes means for storing information associated with said executable function or said first 

3 operation code. 

1 14, The computer program product as claimed in claim 10, wherein said step (b) comprises 

□ 2 augmenting said first operation code in the access plan with another pointer to a data structure, 

3 said data structure providing means for storing information associated with said first operation 

4 code or said executable function. 

1 15. The computer program product as claimed in claim 10, wherein said step (a) further 

2 includes assessing the executable function associated with the first operation code and if 

3 applicable, replacing a call to the executable fiinction with a call to another executable function. 
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1 16, The computer program product as claimed in claim 12, wherein said intermediate 

2 function includes processing operations for the first operation code or the executable fimction 

3 associated with the first operation code. 

1 17. The computer program product as claimed in claim 16, wherein said processing 

2 operations in the intermediate function include gathering statistics on the use of the executable 

3 function associated with the first operation code. 

1 18. The computer program product as claimed in claim 12, wherein said processing 

2 operations in the intermediate function include a pause for receiving user input before or after a 

3 call to the executable function. 

1 19. A relational database management system for use with a computer system wherein 

2 queries are entered by a user for retrieving data from tables, the relational database management 

3 system including a query optimizer for generating an access plan associated with the queries 

4 entered by the user, said relational database management system comprising: 

5 (a) means for determining an executable function associated with each of a plurality 

6 of operation codes in the access plan; and 

7 (b) means for augmenting said operation codes in the access plan with a pointer to 

8 said executable function associated with each operation code. 

1 20. The relational database management system as claimed in claim 19, wherein said means 

2 for augmenting said operation codes includes means for replacing said operation codes in the 

3 access plan with a pointer to an intermediate function, said intermediate function including a data 
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4 structure for storing a pointer to said executable function. 

1 21. The relational database management system as claimed in claim 20, wherein said data 

2 structure includes means for storing information associated with said executable function or said 

3 operation codes. 

1 22. The relational database management system as claimed in claim 19, wherein said means 

2 for augmenting said operation codes includes means for adding another pointer to a data 

3 structure, said data structure providing means for storing information associated with said 

4 operation codes or said executable function. 
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ABSTRACT 

DIRECT CALL THREADED CODE 

A pre-pass and direct call mechanism which replaces the interpreter. The mechanism 
moves static decisions out of the repeated runtime path into a pre-pass operation. 
Advantageously, the mechanism reduces runtime overhead and improves overall performance of 
the DBMS during runtime, while maintaining the considerable investment in opcode generation 
and plan representation. 
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